Matryoshka embedding

Embedding, Representation learning

A class of method where for each embedding vector , any prefix embedding encodes information with corresponding granularity. For instance, in this embedding, a few elements at the beginning of the vectors can still be used as a rough approximation of the full information.

Kusupati2024matryoshka